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ABSTRACT 


Objectives: The aim of the study was to assess the individual’s clinical decision-making ability through Key feature problems 
and to compare Key feature problems with conventional level II based questions among third-year undergraduate dental stu- 
dents in the subject Oral Pathology. 


Study design: The study is an interventional educational research. 


Results: Comparisons between groups A and B were carried out by using descriptive and inferential statistics using Student's 
unpaired t-test and Cronbach’s alpha method of reliability. The software used in the analysis was SPSS 26.0 version and p < 
0.05 is considered as the level of significance. The mean score being 8.93+0.93 for group A-Key feature problem and 7.05+1.28 
for group B- Conventional Level Il. The difference between the two scores was found to be statistically significant with p-value 
less than 0.05. The reliability of Key feature problems was 0.98. 


Conclusion: It was observed in our study that students who were exposed to Key feature problem performed better in decision 
making skills. The Key feature problems do not entirely rely on the factual knowledge but it has the ability to apply the knowledge 
within case-based scenarios comprising of crucial elements and requiring critical decisions at specific decision points during the 
judgement and management of the problem. 
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INTRODUCTION It still had few serious drawbacks such as very low reliability 


__ of the test and thoroughness of data gathering was rewarded 
The essential requirement of health professional education is rather than the ability to make appropriate decisions.' 


an assessment of clinical competence. The major responsibil- 
ities of medical schools are teaching and assessing medical 
student’s skills. The most common approach for evaluating 
skills is through written documentation and direct observa- 
tion of clinical performance. The concept of key feature was 
first introduced by Bordage and Page in the year 1987.' The 
most preferred format for the assessment at that time was 
the written format of patient management problem (PMP) 
that comprised of case-based scenario with sections of items 
which recalled the responses of candidates with respect to 
case history taking, general examination, clinical diagnos- 
tic techniques, investigations, and the diagnosis. This format 
was made popular by its high authenticity and face validity. 


To forbid these drawbacks, Page and Bordage’ suggested 
that every clinical situation has few uncommon, critical ele- 
ments in reaching a diagnosis. These elements individually 
or as a whole play an essential part in the resolution of the 
problem. These elements were named as key features.” Thus, 
a new tool for assessing clinical decision-making skills was 
introduced which recalled the answers from the students in 
relation to the key elements for the resolution of each key 
feature problem.? Examining only the critical elements em- 
powered the students to be examined on a broad range of 
clinical problems than was the case with the patient manage- 
ment problem format. 
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Key feature problems mirror every day or life-threatening 
situations routinely experienced by a general medical prac- 
titioner.*> Using this format, based on the history provided 
one can be judged on his potentiality to arrive at a clinical 
diagnosis. 


We are introducing the idea of a key feature problem in the 
written examinations of clinical decision-making skills in 
Oral Pathology, Sharad Pawar Dental College and Hospital, 
Datta Meghe Institute of Medical Sciences, (Deemed to be 
University), Sawangi (Meghe) Wardha with the purpose of 
encouraging better articulation of clinical decision-making 
skills. 


Following are the objectives needed to accomplish 


1. Introduction and sensitization of dental students and 
faculty with Key feature problems. 

2. To assess the individual’s clinical decision-making 
ability through Key feature problems. 

3. Comparison of Key feature problems with conven- 
tional level II based questions 

4. To evaluate the perception of students regarding Key 
feature problems. 

5. Evaluation of the perception of faculty regarding Key 
feature problems. 


MATERIALS AND METHOD 


After obtaining the clearance from the Institutional ethical 
committee of Datta Meghe Institute of Medical Sciences 
(Deemed to be University), Sawangi (M), Wardha (Annex- 
ure I), 90 students of 3" year BDS 2017 batch were enrolled 
after taking written informed consent during a regular clini- 
cal posting in the Department of Oral Pathology (Annexure- 
II). The students were randomly divided into two groups of 
45 each by the lottery method. These groups were named as 
Group A (Key feature Problem) and Group B (Conventional 
Level II). The study duration was 12 months. 


The key feature problem was introduced to the faculty and 
the students of Group A were sensitized. The examination 
was conducted on key feature problems based on three top- 
ics. All the participants already had the basic theoretical 
knowledge about the clinical features, differential diagnosis, 
investigations, and management of some important oral dis- 
eases which were already taught to them in regular theory 
classes. The problems on key features were structured by the 
faculty members. Three typical clinical scenarios each with 
ten key features on 3 topics were structured serving as a basis 
for defining the key feature problems. The question format 
used was the Long answer menu format. The scoring of the 
questions within the Key feature problems was averaged so 
that each key feature had a maximum rating of “1”, resulting 
in a possible maximum of 10 marks. The students of group A 
were assessed on key feature problems while the students of 


Group B were assessed on conventional level II based ques- 
tions by a similar clinical scenario. 


The preparation of Key feature problem relies on the follow- 
ing steps: 


1. Selection of a clinical problem 

2. Identifying and defining the key elements for each key 
feature problem with a particular age group and clini- 
cal setting 

3. Writing case-based scenarios and questions 

4. Scoring criteria to be set for testing each key element. 


Clear instructions were provided to the students before tak- 
ing this type of examination. The key feature questions were 
evaluated by two assessors. A validated scoring key defines 
the answers or the responses needed to produce a score of 
“1” for each key feature. It also assigns a weight to each cor- 
rect answer of a key feature such as the same weight of 0.25 
to each of four correct answers. The use of equal weighing is 
preferred as the research has shown that the score reliability 
is not improved by the differential weighting. The incorrect 
answers or responses receive a score of “0” regardless of 
other answers for the particular question is used prudently. 


e This educational research study is performed in the 
following steps 


e Step 1-The total number of students attending for 
regular clinical posting comprised of 90 students. The 
students were randomly divided into two groups of 
45 each by the lottery method. Group A-Key feature 
problem and Group B-Conventional Level II. 


e Step 2- Pretest (validated) was conducted for Group A 
students. (Annexure-IIT) 


e Step 3- The students from Group A were sensitized to 
key feature problem. They were instructed not to dis- 
cuss anything about key feature problem and the eval- 
uation method with Group B students. The students 
of Group A were exposed to key feature problem to 
evaluate clinical decision-making skills by providing 
the clinical scenario. 


e Step 4- Post-test (validated) was conducted for Group 
A students. (Annexure-II]) 


e Step 5- For comparison and evaluation between the 
key feature problem and the Conventional level II 
method, the students of Group B were exposed to the 
conventional level II based questions by using the sim- 
ilar clinical scenarios. 

e Step 6- A crossover was done for exposing all the stu- 
dents to both key feature problems and Conventional 
level II based questions concerning ethical issues. 

° Step 7- Feedback from all the students and the faculty 
was obtained. 


The students’ feedback questionnaire consisted of 10 closed- 
ended items and one open-ended item. 
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Faculty feedback questionnaire consisted of 5 closed-ended 
items and two open-ended items. 


A validated pre-test and post-test questionnaire of key fea- 
ture problems consisted of five open-ended questions. All of 
the student’s responses to the pre and post-tests were scored 
according to the appropriateness of answers. The students 
were told that the survey will not affect their grades so they 
could feel free to express their views. Complete confidential- 
ity was maintained for feedback questionnaire. 


OBSERVATIONS AND RESULTS 


The present study was undertaken to evaluate the clinical 
decision-making skills of Dental students using key feature 
problem in the subject of Oral Pathology. The total number 
of students enrolled in the study were 90 undergraduate 34 
year students of Sharad Pawar Dental College (from 2017 
batch). The students were divided randomly into two groups 
of 45 students each. The students from group A were sen- 
sitized and exposed to key feature problem in the subject 
of Oral Pathology to assess clinical decision-making skills. 
Group B was assessed by Conventional level II based ques- 
tions. The scores of students from both groups were subject- 
ed to statistical analysis. The data were subjected to student’s 
unpaired ‘t’ test. The comparison between scores of Group 
A- Key feature problem and Group B- Conventional Level II 
based Questions (Graph 1). The comparison between scores 
of pre-test and post-test for the key feature problem (Graph 
2). The reliability analysis of Key feature problem (Graph 
3). The mean score for each key feature was calculated. It 
was found that more than 90% of students were deficient in 
the areas of the diagnostic techniques to be carried out after 
the identified diagnosis. 33% of students were deficient in 
the areas of investigations to be carried out after the identi- 
fied diagnosis. 20% of students were deficient in the areas of 
metastatic spread of the tumor after the identified diagnosis 
(Table 1). The perception of students regarding key feature 
problem through ten closed-ended questions and one open- 
ended question was taken (Graph 4). The perception of fac- 
ulty regarding key feature problem through five closed-end- 
ed questions and one open-ended question was taken (Table 
2). The findings of open-ended questions were the faculty 
found challenging in the identification of key features for 
structuring key feature problems and also challenging in 
the valuation of key features problems as it is more time- 
consuming. They found that there is no scope for inclusion 
of histopathological diagram which is important as each key 
feature carries only one mark. 


DISCUSSION 


The educational systems of all the medical sciences have the 
responsibility to shift the medical learners from memorizing 


the facts to analytical reasoning and creative problem-solv- 
ing.'* Clinical reasoning is defined as the process by which 
the clinicians or the physicians collect information regard- 
ing the problem with previous experiences and knowledge, 
accordingly plan and execute the interventions to address a 
problem.” Here, the skills of the clinicians play an essential 
role in reaching a diagnosis and successful treatment of the 
problem. It should be taught and tested in medical schools. 
The key features concept relies on the idea of “case specific- 
ity”. Every case has got unique key features. The approach 
delivers an effective deal of variability on question format- 
ting sequels, multiple answers to questions, and marking cri- 
teria. The cases on key features are introduced to evaluate the 
analytical skills instead of simply recollecting the conceptual 
learning. Knowledge is undoubtedly important for solving 
any clinical case effectively; the difficulty faced by the prob- 
lems on key features involves the use of factual knowledge 
to the settlement of a case.” 


The key feature assessment tool is widely used in medical 
education, but the reports related to its use in the dental cur- 
riculum are not yet available where the environment is quiet 
the same in terms of clinical workload, teaching schedules, 
and a number of students. 


With these fundamental needs, we tried to introduce the 
concept of key feature problems among the faculty, and the 
students of Third BDS were sensitized to the concept in the 
subject of Oral Pathology. A total of 90 students was selected 
from 3rd B.D.S and was randomly divided into two groups 
of 45 each by lottery method. 


The students of Group A were exposed to key feature prob- 
lems while Group B students were exposed to Conventional 
Level II based questions. The students of both Group A and 
Group B were assessed for clinical decision-making skills. 
The mean score for key feature problem was 8.93+0.93 and 
the mean score for Conventional level II was 7.05+1.28. The 
result of our study states that students who were exposed 
to key feature problem scored more marks when compared 
to the conventional method. This is in agreement with the 
study conducted by Mitra Amini et al.!! where the total score 
was highest for Key feature problems when compared to 
other tests. The students performed better in clinical deci- 
sion-making skills and this is in agreement with the study 
conducted by Shohreh Zamani et al.'° who stated that Key 
feature problem is a novel evaluation tool with validity evi- 
dence to support its use in the assessment of student’s clini- 
cal decision-making skills. It is important that the students 
follow the instructions and read the clinical scenario and its 
key features carefully to avoid unnecessary loss of marks.7! 
The reliability of key feature problems was high in our study 
i.e., 0.98 whereas the reliability according to the study done 
by Shohreh Zamani et al.!° was found to be 0.75 and accord- 
ing to the study done by Fischer et al. the reliability was 
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0.65.” In our study, the key feature problem examination 
was well perceived by the students. This is in agreement with 
the study conducted by Meike Grumer et al.!” wherein the 
perception of students was taken on Key feature problems 
and the students showed a higher level of acceptance and 
appreciation of the assessment tool. 


The perception of students in group A was taken based on 10 
closed-ended questions and one open-ended question.” The 
findings were more than 90% of students agreed that the key 
feature problem helped them to inculcate previous knowl- 
edge, problem-solving, and clinical decision-making skills. 
Also, more than 90% of students agreed that the key feature 
problem relates closely to the problems that can arise in clin- 
ical practice. The perception of faculty was taken based on 5 
closed-ended questions and two open-ended questions. The 
faculty found that the key feature problems mirror common 
or life-threatening problems typically encountered by family 
physicians. They also found challenges in the identification 
and valuation of key features. There is no scope for inclu- 
sion of histopathological diagram which is important as each 
key feature carries only one mark. They thought the key fea- 
tures of a problem resemble that of Brief answer questions 
(BAQ’s) of Conventional Level II based questions. 


CONCLUSION 


It was observed in our study that students who were exposed 
to key feature problems performed better in decision-making 
skills. The key feature problems do not entirely rely on fac- 
tual knowledge but it has the ability to apply the knowledge 
within case-based scenarios comprising of crucial elements 
and requiring critical decisions at specific decision points 
during judgment and management of the problem. 


An increased emphasis can be made using this tool on teach- 
ing-learning modality around clinical reasoning and decision 
making skills. The learners who are lacking in these areas 
were analyzed and reorientation was carried out. 
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PERCEPTION OF STUDENTS TO KEY FEATURE PROBLEM (KFP) 
1- Strongly disagree; 2- Disagree; 3- Neutral; 4- Agree; 5- Strongly agree 


S.No. Items 1 2 3 4 5 

1. I was instructed/ oriented about KFP before the session. 00(0%) 02(2%) o0(0%) 38(42%) 25(56%) 
2. KFP enabled me to meet the objectives of the course. 

33 KFP helped me in narrowing the differential diagnosis. 


KFP helped me to inculcate previous knowledge, problem solving 
and clinical decision making skills. 


5. It increases conceptual learning & independent critical thinking. 

6. KFP relate closely to the problems that can arise in clinical practice. 

ve I found it interesting in getting to know this kind of assessment 
method. 

8. I found KFP assessment method relatively easy in scoring marks. 

9. The time frame allotted to solve KFP was appropriate. 

10. I wish to have an exam with KFP in the future curriculum. 


ANNEXURE Ill 


Pre-test/Post-test 


What is Key Feature Problem? 

Which skills are tested by Key Feature Problem? 
What does Key Feature Problem reflect? 

Enlist any one advantage of Key Feature Problem 
Enlist any one disadvantage of Key Feature Problem 


By ee a 
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